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SPECIFICATION 
RANGE FINDER DEVICE AND CAMERA 

This application is a U.S. National Phase Application of PCT 
International Application PCT/JP99/02715. 

Technical Field 

The present invention relates to a range finder device for measuring a 
three-dimensional shape of an object. 

Background Art 

As— a range finder device for performing three-dimensional shape 
measurement based on triangulation of projected light and an observed image, 
such as real-time operable range finder deviceas shown in, for example, FIG. 40 
has been proposed. 

In FIG. 40, reference numerals 101 A and 10 IB denote laser light sources 
having slightly different wavelengths; 102, a half mirror for synthesizing laser 
light from the laser light sources having the different wavelengths; 103, a light 
source control part for controlling light intensity of the laser light source; 104, a 
rotary mirror for scanning laser light; 105, a rotation control part for controlling 
the rotary mirror; 106, an object; 107, a lens for forming an image on a_CCD; 
108A and 108B, light wavelength separation filters for separating light having 
wavelength from the laser light source; 109A and 109B, CCDs for picking up a 
monochromatic image; 109C, a_CCD for picking up a color image; 110A and 
HOB, signal processing parts for a monochromatic camera; 111, a signal 
processing part for a color camera; 112, a distance calculation part for 
calculating a distance or a shape of an object from intensity of laser light 
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photographed by CCDs 109A and 109B; and 113, a control part for adjusting 
synchronization of the entire device. Hereinafter, the description will be made 
of the operation of a range finder device thus configured. 

The laser light sources 101 A and 10 IB emit laser light having slightly 
different wavelengths. This laser light is ajine light having a light cross-section 
perpendicular to the scanning direction of a rotary mirror (to be described later) , 
and becomes ajine light in the perpendicular direction when a rotary mirror 
scans in the horizontal direction. 

FIG. 41 shows wavelength characteristics for these two light sources. 
The reason why use of two light sources having close wavelengths to each other 
are used resides in the fact that it is cau se d t o be less influenced by dependency of 
the reflection factor of the object on a_wavelength. The laser light emitted from 
the laser light sources 101A and 101B is synthesized by the half mirror 102, and 
is scanned on the object 6 by the rotary mirror 104. 

This scanning Scanning of the laser light is performed when the rotation 
control part 105 drives the rotary mirror 104 at one field period. At that time, 
light intensities of both light sources is varied as shown in FIG. 42(a) within one 
field period. The variations in the laser light intensity are synchronized wkhby 
driving of the mirror angle, whereby the intensities of those two laser lights are 
monitored by CCD 109A and 109B to calculate the light intensity ratio, making 
it possible to measurea time at one scanning period. If the light intensity is 
Ia/Ib,, as shown in, for example, FIG. 42(b), the scanning time is measured to be 
tO, and a rotation angle (<|>) of the rotary mirror 104 can be knewn determined 
from the measured value. 

The ratio of the intensities of those two laser lights and the mirror angle 
(that is, angle of the object as viewed from the light source side) are caused to 
have a one-to-one correspondence therebetween in this manner , whereby the 
distance or shape of the object can be calculated from a ratio of signal levels on 
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which light from both light sources has been photographed in a distance 
calculation part (to be described later), in accordance with the principle of 
triangulation. 

The lens 107 forms an image of the object on CCDs 109A, 109B and 
109C. The light wavelength separation filter 108A transmits light in wavelength 
of the light source 101 A, and reflects light in another wavelength. The light 
wavelength separation filter 108B transmits light in wavelength of the light 
source 101B, and reflects light in another wavelength. As a result, reflected 
light of light o f from the light sources 101 A and 101 B from the object is 
photographed by the CCDs 109A and 109B, and light of another wavelength is 
photographed by the CCD 109C as a color image. 

The light source A signal processing part 110A and light source B signal 
processing part HOB performthe similar signal processing to an ordinary 
monochromatic camera for the output from the CCDs 109 A and 109B. The color 
camera signal processing part 111 performs an ordinary color camera signal 
processing for to the output from the CCD 109C. 

The distance calculation part 112 calculates a distance for each pixel 
from using the signal level ratio, base length and coordinate values of pixels 
which have been photographed by the CCDs 109 A and 109B for wavelength of 
each light source. 

FIGS. 43(a) and (b) are explanatory views useful for graphically 
illustrating the distance calculation. In the figures, the reference character O 
denotes a center of the lens 107; P, a point on the object; and Q, a position of an 
axis of rotation of the rotary mirror. Also, for brevity, the position of the CCD 
109 is shown turned around on the object side. Also, assuming the length of OQ 
(base length) to be L, an angle of P as viewed from Q in the XZ plane to be ()>, 
an angle of P as viewed from O to be 0, and an angle of P as viewed from O in 
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the YZ plane to be o, the three- three-dimensional coordinate of P can be 
calculated by the following formula (1) from the graphical relation. 

Z = D tan 9 tan 4 /(tan 0 + tan <|>) (1) 

X = Z / tan 9 

Y = Z / tan co 

The (j) in the formula (1) is calculated by the light intensity ratio of laser 
light sources 101A and 101B monitored by the CCDs 109A and 109B, as 
described above, and 9 and co are calculated from coordinate values of pixels. 
Of the values shown in the formula (1), if all of them are calculated, the shape 
will be determined; and if only Z is determined, the distance image will be 
determined. 

On the other hand, for photography ferof a place where light from the 
light source cannot be directly irradiated onto an object, there has been known a 
camera using which uses an optical fiber. For example, as one of in endoscopes 
to be used at the time of for examining the interior of a_human body, there areis a 
gastrocamera and the like. In the case of the gastrocamera, the inner walls of 
the stomach isare normally irradiated by light irradiation from the optical fiber, 
and reflected light from the inner wall portion is received by another optical 
fiber to-be which is guided toby an external camera part, and this is two- 
dimensionally processed to display thea normal image on a monitor. 

As a conventional object extraction method, the technique called "Chroma 
key 1 1 " Chroma key" used in broadcasting stations is generally used. 

This method is to arrange arranges an object in front of a studio set 
configured by the background of a single color (blue) for photographing, and te 



MTS-3185US 



- 5 - 



Marked-up Copy of 
Original Specification Text 



judg ejudges that the blue portion is the background regarding and any portions 
other than it as an attention object. 

In such a conventional configuration as described above, however, a 
modulatable modulated light source and light source sweeping means are 
indispensable, and there was a problem that since mechanical operations are 
included, the reliability of the device is low and the device is expensive. 

Also, although the laser element is normally modulated for use, the output 
and wavelength of the laser element vary depending upon the temperature, and^ 
therefore,thefe — is — a — problem — that it is difficult to realize — stable 
measurement. obtain stable measurements. 

Also, as in case of the conventional endoscope or the like, for 
photography form a place where light from the light source cannot be directly 
irradiated onto an object, there — was — the problem — that it is difficult to 
examine determine whether or not there is any projecting region, because the 
image is of two-dimensional data in a camera using the optical fiber. 



Disclosure of the Invention 

The present invention has been achieved inthe light of such problems, and 
is aimed aims to provide a stable range finder device free from any mechanical 
operations at operations, at a low cost. 

It is another object of the present invention to provide a range finder 
capable of measuring a distance of an object in a place where light from a light 
source cannot be directly irradiated onto the object. 
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It is further another object of the present invention to provide a camera 
which is simple in configuration and compact in size. 

That is, the present invention is a range finder device, for measuring, 
when a plurality of projected lights having radiation patterns whose light 
intensity differs three dimensional space wise are irradiated onto an object from 
a light source on a time sharing basis to image p i ck u p reflected light of said 
projected light from lights, having radiation patterns whose light intensity differs 
three-dimensional space-wise, are irradiated onto an object from a light source 
on a time-sharing basis to image-pick up reflected said object with a camera, a 
distance using the light intensity of an image picked up, 

characterized in that, with respect to each of a plurality of surfaces 

including the center of said light source and the center of a lens, there is 
obtained, in advance, relation between an angle of each projected light from said 
light so urce and light intensity in each surface, 

characterized in that, at the time of actual distance measurement, light 

intensity of each pixel of said camera is measured, and on the basis of the light 
inten s ity thus measured, and relation between said angle and said light intensity 
on a predetermined surface corresponding to a coordinate position of said pixel 
measured, there is obtained said angle corresponding to said light intensity of the 
predetermined pixel thus measured, and 

characterized in that, on the basis of these light inten s ity measured, said 

angles obtained and further two dimensional coordinate position information on 
said predetermined pixel on the image, a distance to said object is calculated. 



ft 

1 * 
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Further, the present invention is a range finder device, characterized by 

comprising: 

a light source; 

a first optical fiber for guiding light to be emitted from said light source; 

light distribution means for dividing light guided by said first optical fiber 

into a plurality of courses; 

a plurality of second optical fibers whose one end is connected to said 

light distribution means, for irradiating said light divided from an aperture at the 
other end thereof onto said object; 

image pickup means for receiving reflected light of said irradiated light to 

acquire image data of said object; and 

distance calculation means for calculating a distance to said object on the 

basis of said image data, 

characterized in that intensity of light to be irradiated onto said object 

from said other end of each of said plurality of second optical fibers has 
distribution which is different on place. 

Further, the present invention is a camera for shape measuring or object 

e xtracting, having light emitting means for irradiating an object with projected 
light having a specified radiation pattern, for picking up reflected light of said 
light emitting means from said object to obtain a depth image using light 
intensity of the image picked up, characterized in that said camera has such a 
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structure that a distance between said light emitting means and an image - pickup 
lens is variable, and characterized in that the interval between said light emitting 
means and said image pickup lens can be taken sufficiently larg e during the use. 

light of the projected light from the object with a camera, a distance using the 
light intensity of an image picked up. 

In an exemplary embodiment of the present invention, with respect to 

each of a plurality of surfaces including the center of the light source and the 
center of a lens, there is obtained, in advance, relation between an angle of each 
projected light from the light source and light intensity in each surface. 

In an exemplary embodiment of the present invention, at the time of 

actual distance measurement, light intensity of each pixel of the camera is 
measured, and on the basis of the light intensity thus measured, and relation 
between the angle and the light intensity on a predetermined surface 
corresponding to a coordinate position of the pixel measured, there is obtained 
the angle corresponding to the light intensity of the predetermined pixel thus 
measured. 

In an exemplary embodiment of the present invention, on the basis of die 

light intensity measured, the angles obtained, and further two-dimensional 
coordinate position information on the predetermined pixel on the image, a 
distance to the object is calculated. 

Further, the present invention is a range finder device, that includes a 

light source, a first optical fiber for guiding light to be emitted from the light 
source, light distribution means for dividing light guided by the first optical fiber 
into a plurality of courses, and a plurality of second optical fibers with one end 
connected to the light distribution means. The second optical fibers irradiate the 
light divided from an aperture at the other end thereof onto the object. The 
range finder device also includes image pickup means for receiving reflected 
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light of the irradiated light to acquire image data of the object, and distance 
calculation means for calculating a distance to the object on the basis of the 
image data. Intensity of light to be irradiated onto the object from the other end 
of each of the plurality of second optical fibers has a distribution which is 
different. 

Further, the present invention is a camera for shape measuring or object 
extracting, having light-emitting means for irradiating an object with projected 
light having a specified radiation pattern, and for picking up reflected light of the 
light-emitting means from the object to obtain a depth image using light intensity 
of the image picked up. The camera has a structure such that a distance between 
the light-emitting means and an image-pickup lens is variable, and the interval 
between the light-emitting means and the image-pickup lens can be sufficiently 
large during use of the camera. 

Brief Description of the Drawings 

FIG. 1 is a block diagram showing illustrating the configuration of a range 
finder device according to a first embodiment of the present invention; 

FIG. 2(a) is a perspective view showing illustrating the configuration of a 
light source in the range finder device according to the first embodiment, and 
FIG. 2(b) is a plan view showing the configuration of a light source in the range 
finder device according to the first embodiment; 

FIG. 3 is a view showing illustrating a light pattern of a light source 
according to the first embodiment; 

FIG. 4 is a view showing illustrating a light pattern of a light source 
according to the first embodiment and a light pattern in the case of emitting a 
plurality of lights; 
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FIG. 5 is a view showing relation illustrating the relationship between a 
light intensity ratio according to the first embodiment and an angle § from a light 
source; 

FIG. 6 is a calculation conceptual view shovving illustrating three- 
dimensional positions X, Y and Z in the first embodiment; 

FIG. 7 is a block diagram showing illustrating the configuration of a range 
finder device according to a second embodiment of the present invention; 

FIG. 8 is a block diagram showing illustrating a distance calculation and a 
light intensity conversion according to the second embodiment; 

FIG. 9 is a view showing illustrating a change in X-coordinate of light 
intensity in the second embodiment; 

FIG. 10(a) is a block diagram showing illustrating the configuration of a 
range finder device according to a third embodiment of the present invention, 
and FIG. 10(b) is a block diagram showing illustrating the configuration of a 
modification of a range finder device according to the third embodiment of the 
present invention; 

FIGS. 11(a) to (c) are explanatory views illustrating an arrangement of a 
lens system according to the third embodiment, and FIG. 11(d) is an explanatory 
view illustrating an arrangement of a transmittance change filter according to the 
third embodiment ; 

FIG. 12(a) is an explanatory view illustrating the transmittance change 
filter according to the third embodiment, and FIG. 12(b) is an explanatory view 
illustrating a_distribution of light intensity based on the transmittance change 
filter according to the third embodiment; 
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FIGS. 13(a) and(b) are outside drawings showing cameras perspective 
views of cameras useful for shape measurement and object extraction according 
to a fourth embodiment of the present invention; 

FIG. 14 is a block diagram showing illustrating the configuration of a light 
source part of a camera according to the fourth embodiment of the present 
invention; 

FIG. 15 is a view showing illustrating the principle of a light source part 
of a camera according to the fourth embodiment of the present invention; 

FIG. 16 is a view showing illustrating the light intensity of a light source 
part of a camera according to the fourth embodiment of the present invention; 

FIG. 17 is a view showing illustrating a light intensity pattern of a light 
source part of a camera according to the fourth embodiment of the present 
invention; 

FIG. 18 is a view showing illustrating a light intensity pattern of a light 
source part of a camera according to the fourth embodiment of the present 
invention; 

FIG. 19 is a view showing illustrating a light intensity ratio of a light 
source part of a camera according to the fourth embodiment of the present 
invention; 

FIGS. 20(a) and (b) are block diagrams showing illustrating a camera 
according to the fourth embodiment of the present invention; 



FIGS. 21(a) to (d) are block diagrams showing a camera (2) illustrating a 
camera according to the fourth embodiment of the present invention; 
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FIGS. 22(a) and (b) are outside drawings showing a camera (3) illustrating 
a camera according to the fourth embodiment of the present invention; 

FIGS. 23(a) to (c) are block diagrams showing a camera ( 4 i llustrating a 
camera according to the fourth embodiment of the present invention; 

FIGS. 24(a) to (d) are block diagrams showing illustrating a light source 
part of the camera(2) according to the fourth embodiment of the present 
invention; 

FIG. 25 is a view showing illustrating a display method(±) of a camera 
according to a fifth embodiment of the present invention; 

FIG. 26 is a view showing illustrating a display method(2) of a camera 
according to the fifth embodiment of the present invention; 

FIG. 27 is a rear outside drawing showing perspective drawing illustrating 
a camera according to the fifth embodiment of the present invention; 

FIG. 28 is a block diagram showing illustrating a camera according to the 
fifth embodiment of the present invention; 

FIG. 29 is a view showing illustrating an image correcting operationfl) of 
a camera according to the fifth embodiment of the present invention; 

FIG. 30 is a view showing illustrating an image correcting operation^ of 
a camera according to the fifth embodiment of the present invention; 

FIG. 31 is another block diagram showing illustrating a camera according 
to the fourth embodiment of the present invention; 
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FIG. 32 is a view showing occurrence o f illustrating occlusion in cameras 
according to the fourth and fifth embodiments of the present invention; 

FIG. 33 is a view shovving iilustrating occlusion in cameras according to 
the fourth and fifth embodiments of the present invention; 

FIG. 34 is a view shovving iilustrating a method of avoiding occlusion in 
cameras according to the fourth and fifth embodiments of the present invention; 

FIGS. 35(a) and (b) are outside drawings for avoiding occlusion in a 
camera (1 i llustrations of a camera according to the fourth and fifth embodiments 
of the present invention; 

FIGS. 36(a) and (b) are outside drawings for avoiding occlusion in a 
camera (2) additional illustrations of a camera according to the fourth and fifth 
embodiments of the present invention; 

FIGS. 37(a) and (b) are outside drawings for showing illustrations of an 
external light source part(4} in a camera according to the fourth and fifth 
embodiments of the present invention; 

FIGS. 38(a) and (b) are outside drawings for showing illustrate an external 
light source part(2) in a camera according to the fourth and fifth embodiments of 
the present invention; 

FIGS. 39(a) and (b) are outside drawings for showing illustrate an external 
light source part(3) in a camera according to the fourth and fifth embodiments of 
the present invention; 

FIG. 40 is a block diagram showing illustrating a conventional range 
finder device; 
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FIG. 41 is a characteristic diagram showing illustrating wavelength 
characteristics of a light source for a conventional range finder device; 

FIGS. 42(a) and (b) are characteristic diagrams s hovving illustrating 
intensity modulation in a light source for a conventional range finder device; and 

FIGS. 43(a) and (b) are views showing the principle o f illustrating 
measurement principles in a range finder. 

(Description of the Symbols) 

1 Camera 

la Infrared camera 

2a Light source 

2b Light source 

3a Infrared transmission filter 

3b Infrared transmission filter 

4a ND filter whose transmittance varies in the horizontal direction 

4b ND filter whose transmittance varies in the horizontal direction 

5 Light source control part 

6 Distance calculation part 
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7 Flash light source 

8 Flash light source 

9 Passive reflection plate 

10 Passive reflection plate 
11a Field memory a 

lib Field memory b 

12a Light intensity conversion part a 

12b Light intensity conversion part b 

13 Light intensity ratio calculation part 

14 Distance conversion part 
101 A Laser light source 
101B Laser light source 

102 Half mirror 

103 Light source control part 

104 Rotary mirror 

105 Rotation control part 
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106 Object 

107 Lens 

108 A Light wavelength separation filter 
108B Light wavelength separation filter 
109A Image pickup element 
109B Image pickup element 
109C Color image pickup element 
1 10A Camera signal processing part 
HOB Camera signal processing part 

111 Color camera signal processing part 

1 12 Distance calculation part 

113 Control part 

201 Semiconductor laser 

202 First optical fiber 

203 Light distributor 

204 Collimator lens 
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206 Camera part 

207 Second optical fiber 

501 Housing 

502 Housing503 Lens 

504 Recording media 

505 First strobe 

506 Second strobe 

507 Finder 

508 Strobe part 

509 Camera body housing 

510 Joint part 

511 Camera body 

512 Light source part housing 

513 Light source part housing 

514 Third strobe 

515 Fourth strobe 
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516 Joint part 

517 Light source part 

518 Display panel 

519 Touch panel 

520 Object (foreground) 

521 Object (background) 

527 Portion judged to be the foreground by malfunction 

528 Shading plate 

529 Strobe light-emitting tube A 

530 Strobe light-emitting tube B 

531 Liquid crystal barrier 

532 Display part 

533 Image pickup part 

534 Light control part 

535 Distance calculation part 

536 Color image calculation part 
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537 Control part 

538 Media recording and reproducing part 

539 Analysis part 

540 Object (foreground) 

541 Object (background) 

542 Portion for which light from the light source part is intercepted 

543 Light source part 3 

544 Light source part 4 

545 Camera mounting screws . 

546 Light source part housing (1) 

547 Light source part housing (2) 

548 Light source part fixing base 

549 Light source part fixture (strobe shoe fitting) 

550 Image memory 

551 Passive reflection plate (1) 

552 Passive reflection plate (2) 



MTS-3185US - 20 - Marked-up Copy of 

Original Specification Text 



5100 Portion which has been judged to be the background 



Best Mode for Carrying Out the Invention 

Hereinafter, with reference to the drawings, the description will be 
made descriptions of a range finder device according to embodiments of to the 
present invention will be provided . 

(First Embodiment) 

FIG. 1 is a block diagram showing illustrating a range finder according to 
a first embodiment of the present invention. In FIG. 1, the reference numeral 1 
denotes a camera; 2a and 2b, light sources; 5, a light source control part; and 6, 
a distance calculation part. Hereinafter, the description will be made of an 
operation of the above above- described configuration. 

The light source control part 5 causes the light sources 2a and 2b to 
alternately emit light for each field period in synchronism with a vertical 
synchronizing signal of the camera 1 . As the light Light sources 2a and 2b, there 
can be used those in which 2b may include flash light sources 7 and 8 such as 
xenon flash lamps that are lengthwise arranged and the directions of passive 
reflection plates behind them are laterally deviated as shown in, for example, 
FIG. 2(a). FIG. 2(b) is a plan view of FIG. 2(a). The light sources 2a and 2b 
radiate light within ranges A and B respectively. This xenon lamp has a small- 
sized light emitting portion, and one which can be regarded as a point light 
source as viewed from above is preferable . Further, the light sources 2a and 2b 
are lengthwise arranged, and the distance therebetween is about 1 cm, and these 
light sources leek appear as if light was emitted substantially from one point. 
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A n example of a light pattern to be radiated from such light sources 
becomes as is shown in FIG. 3. This indicates, whe n When light is projected onto 
a provisional screen, a size of the brightness of the screen surface is shown by a 
direction -> in the figure. That is, the respective- light sources have 
characteristic properties that the screen surface is brightest at the central axis, 
and becomes darker toward the marginal portion. It is bright at the center and 
dark in the marginal portion in this manner because semi-cylindrical passive 
reflection plates 9 and 10 are located behind the flash light sources 7 and 8. 
Also, the directions of those semi-cylindrical passive reflection plates 9 and 10 
are deviated, and the respective projected light is emitted so that it is partially 
overlapped. 

FIG. 4 shows relation the relationship between angles of projected light 
from the light sources and light intensity in a plane of the H direction of FIG. 3. 
This H direction is a direction of a crossing line between an arbitrary plane S, of 
a plurality of planes including the center of the light source and the lens center, 
and the above-described provisional screen. In the a portion of these light 
patterns, light to be irradiated from the two light sources into the object space 
becomes bright on the right side in one and bright on the left side in the other, as 
viewed from each light source. This pattern varies, however, also in the height- 
wise direction (Y direction). 

FIG. 5 indicates the relation ship between the light intensity ratio in the 
object illumination by the two projected lights^ and an angle <|>, made by the X- 
axis, of the one obtained by projecting the projected light onto the XZ plane in 
the a portion in FIG. 4. In the a portion, the relation ship between the light 
intensity ratio and angle <J) is a one-to-one correspondence. In order to measurea 
distance, two types of light patterns are alternately projected onto a plane, which 
isare spaced apart by a predetermined distance from the light sources and isare 
set up vertically, and such data on the relation ship between the light intensity 
ratio and the angle of projected light as is_shown in FIG. 5 is obtained in 
advance for each Y-coordinate (which corresponds to Y-coordinate on CCD) 
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from the result obtained by image-picking up this reflected light with the camera 
1. The "for each Y-¥-coordinate" means for each of a plurality of planes 
including the light source center and the lens center. 

Also, if the light sources are located such that a segment between the lens 
center of the camera 1 and the light sources runs parallel to the X-axis of the 
CCD image pickup surface, distance calculations can be accurately performed 
through the use of data on the relation betwee n relating to the light intensity ratio 
determined for each Y-coordinate and the angle of projected light. Hereinafter, 
the description will be made of a distance calculation method using the light 
intensity ratio. 

When a point P in FIG. 1 is set to an attention point, an angle § of the 
point P as viewed from the light sources is measured through the use of a 
luminance ratio obtained from image pickup data when two types of light 
patterns are irradiated concerning the point P in an image picked up by the 
camera 1 , and the relation of FIG. 5 corresponding corresponds to a Y-coordinate 
value of the point P. In this respect, an assumption is made that the relation of 
FIG. 5 hasthe characteristic properties that vary depending upon the Y- 
coordinate value as described above, and that the relation ship between the light 
intensity ratio and an angle <j> from the light sources in the horizontal direction 
has been prepared by a_preliminary measurement for each Y-coordinate. Also, 
an angle 9 with respect to the point P as viewed from the camera is determined 
by the position (that is, pixel coordinate value of the point P) inof the image, and 
a camera parameter (focal length, optical center position of the lens system). 
Thus, the distance is calculated from the two angles and a distance (base length) 
between the light source position and the optical center position of the camera in 
accordance with the principle of triangulation. 

Assuming that the optical center of the camera to be is the origin, setting 
the optical axis direction of the camera as the Z-axis, the horizontal direction as 
X-axis, and the perpendicular direction as Y-axis, and assuming an angle, made 
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by the X-axis, of the direction of the attention point as viewed from the light 
source to be <|>, an angle, made by the X-axis, of the direction of the attention 
point as viewed from the camera to be 0, and the light source position to be (0, - 
D), that is, the base length to be D, and the depth value Z of the attention point 
P can be calculated from the above- above described formula (1) 

Z = D tan 9 tan (j) /(tan 0 - tan c|>) 

According to the present embodiment as described above, a distance is 
measured by correcting any variations in the light intensity generated by the light 
sources or the optical system at the time of measuring the distance by means of a 
range finder using light intensity, whereby it is possible to realize a stable range 
finder device with high precision capable of implementing all implementation by 
electronic operations. 

In this respect, at the front of an infrared camera having a range finder 
according to the present embodiment, a half mirror or a dichroic mirror and a 
color camera are arranged, whereby a color image having the same viewpoint 
as well as the distance image can be obtained, and this technique is included in 



In this respect, in the distance calculation part according to the present 
embodiment, the description has been made of the case provided where only the 
distance Z is calculated to output the calculation result as a distance image, but it 
may be possible to output three-dimensional coordinate data by calculating all 
three-dimensional coordinate values X, Y and Z from formulas (1) and (2) using 
an angle co shown in FIG. 6, and this technique is included in the present 
invention. 




obtained invention . 



X = Z / tan 0 



Y = Z / tan co 



(2) 
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In this respect, in the present embodiment, if light sources 2a and 2ba*e 
caused to emit light at the same time, and are used as a normal flash lamp in 
which brightness in one center is great and the marginal portion becomes dark as 
indicated by a dotted line in FIG. 4, a normal two-dimensional image can be 
image-picked up. 

Also, in the present embodiment, if an infrared passing filter is inserted at 
the front of the light source 2 and a filter having sensitivity in an infrared 
wavelength area is used for the camera 1 , it is made possible to prevent lighting 
of a flashlight from hindering the user or an image pickup picture by the user or 
the other camera. Also, if an image is image-picked up coaxially with the 
infrared camera and by an ordinary color camera using a half mirror, a dichroic 
mirror and the like, a depth image and a texture image corresponding thereto can 
also be image-picked up at the same time. 

Also, in the present embodiment, since the flashlight flashes for a given 
time (e.g., hundreds microsecond, of microseconds), if the camera 1 is set so as 
to be exposed by means of a shutter operation only during such time p eriod, it 
will be is possible to suppress the background light from affecting the distance 
measurement and to image-picked up a distance image even in a place which is 
bright to some degree. 

Also, in the present embodiment, two types of light patterns are irradiated 
onto an object, and the light intensity ratio for each pixel has been is calculated 
using image pickup pictures in the respective cases. It may be possible, 
however, to also image-pick up an image when no light pattern is irradiated and 
obtain three types (two types of light patterns and one type of no light pattern) of 
images in total for calculations. In this case, at the time of calculating to 
calculate the light intensity ratio for each pixel, a differential value obtained by 
subtracting light intensity in the absence of any light pattern from the respective 
light intensity values during light pattern irradiation will be calculated. Then, a 
ratio of these differential values will be calculated to make it into determine the 
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light intensity ratio. Thus, in the case of image pickup in a bright place, it is 
possible to suppress distance calculation error based on background light. 

(Second Embodiment) 

FIG. 7 is a block diagram showing a range finder device according to a 
first embodiment of the present invention. In FIG. 7, the reference numeral la 
denotes a camera having sensitivity in infrared light; 2a and 2b, light sources; 3a 
and 3b, infrared transmission filters; 4a and 4b, ND filters whose transmittance 
varies in the horizontal direction; 5, a light source control part; and 6, a distance 
calculation part. Hereinafter, the description will be made of an operation of the 
above-described configuration. 

The light source control part 5 causes the light sources 2a and 2b to emit 
light for each field period in synchronism with a vertical synchronizing signal of 
the infrared camera la. As the light Light sources 2a and 2b, a light source such 
as2b may include a xenon lamp, which flashes, having and has a small-sized light 
emitting portion, (which can be regarded as a point light source) , is preferable . 
Also, the light sources 2a and 2b are arranged in the vertical direction. 

At the front of each light source, there are arranged infrared transmission 
filters 3a and 3b, and ND filters 4a and 4b. The transmittance of the ND filter 
4a, 4b varies in the horizontal direction. FIG. 2 shows a relation between an 
angle from the light source in the horizontal direction and the transmittance of 
the ND filters 4a and 4b. 

Because of these ND filters, light to be irradiated in object space from the 
two light sources becomes bright on the right side in one of the light sources, 
and bright on the left side in the other of the light sources, as viewed from the 
light sources. As a result, light which is bright on the right side or on the left 
side as described above is alternately projected onto the object for each field 
period. 
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FIG. 5 indicates a relation illustrates the relationship between the light 
intensity ratio of the two projected lights and an angle from the light sources in 
the horizontal direction. Hereinafter, the description will be made of a distance 
calculation method using the light intensity ratio. 

When a point P in FIG. 7 is set to an attention point, an angle of the point 
P as viewed from the light source is measured from a luminance ratio between 
fields concerning the point P in an image image-picked up by the camera la 
through the use of the relation o f relationship illustrated in FIG. 5. Also, an 
angle with respect to the point P as viewed from the camera is determined from 
the position (that is, pixel coordinate value of the point P) in the image, and a 
camera parameter (focal length, optical center position of the lens system). 
Thus, the distance is calculated from the two angles and a distance (base length) 
between the light source position and the optical center position of the camera in 
accordance with the principle of triangulation. 

Assuming the optical center of the camera to be the origin, setting the 
optical axis direction of the camera as the Z-axis, the horizontal direction as the 
X-axis and the vertical direction as the Y-axis, and assuming an angle, made by 
the X-axis, of the direction of the attention point as viewed from the light source 
to be (j), an angle, made by the X-axis, of the direction of the attention point as 
viewed from the camera to be 9, and the light source position to be (0, -D), that 
is, the base length to be D, the depth value Z of the attention point P can be 
calculated as using the following formula: 

Z = D tan 9 tan 4> /(tan 9 - tan (J>) 

The distance calculation part 6 calculates a distance image from a video 
signal of the camera la. The calculation method may be accomplished in the 
same manner as in the first embodiment , — and — there — is another method 
capable embodiment. Another method of performing more accurate measurement 
as measurements is described below. FIG. 8 is a block diagram 



MTS-3185US - 27 - Marked-up Copy of 

Original Specification Text 



showing illustrating the distance calculation part 6. In FIG. 8, the reference 
numerals 11a and lib denote field memories; 12a and 12b, light intensity 
correction means; 13, light intensity ratio calculation means; and 14, distance 
conversion means. Hereinafter, the description will be made of the operation of 
each component. 

An image image-picked up by the camera la is written in the field 
memories 11a and lib by each field. 

The light intensity correction means 12a and 12b is means are for 
correcting the light intensity written in the field memories. The reason for the 
correction will be described below. FIG. 9 shows a relation illustrates the 
relationship between the light intensity to be image-picked up and the pixel 
coordinate value when light is irradiated (in a state free from any ND filter) on a 
screen having a fixed distance Z from a point light source to image-pick up light 
reflected by the surface. FIG. 9 one dimensionally shows only in only illustrates 
the horizontal direction (one-dimension) for brevity, but the light intensity 
likewise also shows curvilinear distributionatee in the vertical direction. 

As causes for this This distribution, there are conceived may result from, 
for example, peripheral extinction based on the lens system of the camera, 
variations in intensity of reflected light caused by variations in the angle of 
incidence of a ray of light with respect to the object surface, and variations in 
light intensity due to an angle from the light sources among others. sources. Since 
the variations in light intensity cau s ed by these c auses become result in errors at 
the time of observing the light intensity ratio, that is, errors during distance 
measurement, it becomes necessary to convert the light intensity in order to 
improve the accuracy of the distance measurement accuracy . The presence of 
these errors may cause any portion other than a monotonous increasing curve in 
the characteristic curve of FIG. 5. In such a portion, the light intensity and the 
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angle do not have a one-to-one correspondence therebetween, and as a result, the 
measurement result is disturbed. Also, if there were not these errors, there 
would be advantages that the light intensity (ratio) in the Y axis direction 
becomes constant, and that one conversion table of FIG. 5 is required (in the 
first embodiment, a conversion table for the number for Y coordinate value is 
required). 

In order to reduce the measurement errors in the light intensity conversion 

means 12a and 12b, two dimensional curve distribution in light intensity in an 
image on a screen spaced apart by a reference distance in the absence of the ND 
filter is measured in advance, and at the time of obtaining relation 
(corresponding to FIG. 5) between the light intensity and the angle of the 
pro j ected light, and at the time of measuring an actual distance of the object, the 
light intensity of the field memory is corrected and converted in accordance with 
the curve distribution in light intensity measured in advance. A factor (that is, 
ratio of light intensity picked up in each pixel corresponding to a peak value or 
an arbitrary value) for correcting the curve distribution of light intensity to a 
fixed value is held as a two dimensional LUT (look up table), and the correction 
and conversion are performed by multiplying the data in the field memory by a 
correction factor for each pixel. 

The reference distance is, if a distance in arranging the object is known in 

advance, set to a value close to the distance, to thereby make it possible to 
improve the accuracy at the time of measuring the distance. 

According to the present embodiment as described above, a distance is 

mea s ured by corr e cting any errors in light intensity caused by a light source or 
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an optical system at the time of measuring the distance by means of a range 
finder using light intensity, whereby it is possible to realize a stable range finder 
device wi th high p recision capable of implementing all by electronic operations. 

In this respect, at the front of an infrared camera having a range finder 

according to the present embodiment, a half mirror or a dichroic mirror and a 
color camera are arranged, whereby a color image having the same point of view 
as-weU not for these errors, the light intensity (ratio) in the Y-axis direction 
would advantageously be constant, and one conversion table as shown in FIG. 5 
would be used (in the first embodiment, a conversion table for the number for Y- 
coordinate value is required). 

In order to reduce the measurement errors in the light intensity conversion 
means 12a and 12b, a two-dimensional curve distribution of light intensity in an 
image on a screen spaced apart by a reference distance in the absence of the ND 
filter is measured in advance, and at the time of obtaining the relationship 
(corresponding to FIG. 5) between the light intensity and the angle of the 
projected light, and at the time of measuring an actual distance of the object, the 
light intensity of the field memory is corrected and converted in accordance with 
the curve distribution of light intensity measured in advance. A factor (that is, 
the ratio of light intensity picked up in each pixel corresponding to a peak value 
or an arbitrary value) for correcting the curve distribution of light intensity to a 
fixed value is held as a two-dimensional LUT (look-up table), and the correction 
and conversion are performed by multiplying the data in the field memory by a 
correction factor for each pixel. 

If a distance of arranging the object is known in advance, the reference 
distance is set to a value close to the known distance, thereby making it possible 
to improve the accuracy at the time of measuring the distance. 

According to the present embodiment as described above, a distance is 
measured by correcting any errors in light intensity caused by a light source or 
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an optical system at the time of measuring the distance by means of a range 
finder using light intensity, whereby it is possible to realize a stable range finder 
device with high precision capable of implementation by electronic operations. 

In this respect, at the front of an infrared camera having a range finder 
according to the present embodiment, a half mirror or a dichroic mirror and a 
color camera are arranged, whereby a color image having the same point of view 
as the distance image can be obtained. 

In this respect, in the distance calculation part according to the present 
embodiment, the description has been made of the example in which only the 
distance Z is calculated and the calculation result is outputted as the distance 
image, but it is possible to calculate ali a description has been presented where 
only the distance Z is calculated and the calculation result is outputted as the 
distance image, but it is possible to calculate all of the three-dimensional 
coordinate values X, Y and Z using the angle co shown in FIG. 6 from the 
following formulas: 

Z = D tan 9 tan $ /(tan 9 - tan <j>) 

X = Z / tan 9 

Y = Z / tan co 

and to output the corresponding three-dimensional coordinate data. 

In this respect, i flregarding the light intensity correction in the distance 
calculationpaft according to the present embodiment, in the case where when the 
object is spaced apart from the reference distance, the position of pixels to be 
image-picked up is shifted- (that is, a parallax occurs) and therefore, the distance 
measurement precision is deteriorated. In such a case, a plurality of light 
intensity correction amounts for corrections for the reference distances arecan be 
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prepared in advance, such that the correction for a certain reference distance is 
first performed to calculate the distance, and subsequently, the distance is 
calculated again by using a correction amount for a reference distance close to 
the previous casete thereby make making it possible to improve the measurement 
precision. 

In this respect, in the present embodiment, if light sources 2a and 2bare 
caused to emit light at the same time, and are used as a normal flash lamp in 
which brightness in one center is great and the marginal portion becomes dark as 
indicated by the dotted line in FIG. 4, a normal two-dimensional image can be 
picked up. 

Also, in the present embodiment, if an image is picked up coaxially with 
the infrared camera and by an ordinary color camera using a half mirror, a 
dichroic mirror 2 and the like, a depth image and a texture image corresponding 
thereto can also be picked up at the same time. 

Also, in the present embodiment, since the flashlight flashes for a certain 
period of time (e.g., hundreds microsecond, of microseconds), if it is set such 
that the camera 1 is exposed by means of a shutter operation only during thethat 
period of time, it will be is possible to suppress the background light from 
affecting the distance measurement and to pick up a distance image even in a 
place which is bright to some degree. 

Also, in the present embodiment, two types of light patterns are irradiated 
onto an object, and the light intensity ratio for each pixel has been is calculated 
using image pickup pictures in the respective cases . It may be possible, 
however, to also pick up an image when no light pattern is irradiated and to 
obtain three types (two types of light patterns and one type of no light pattern) of 
images in total for calculation. the calculations. 
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In this case, at the time of in calculating the light intensity ratio for each 
pixel, a differential value obtained by subtracting light intensity without light 
pattern from the respective light intensity values during light pattern irradiation 
will be calculated. Then, a ratio of these differential values will be calculated to 
make it into convert it to the light intensity ratio. Thus, in the case of image- 
picking up in a bright place, it is possible to suppressany distance calculation 
error based on background light. 

Also, for the light pattern to be projected onto an object in the present 
embodiment, it may be possible to use a light transmission type liquid crystal 
display device (such (e.g., a deviceas used in an ordinary liquid crystal video 
projector)and one light source in place of the ND filters 4a and 4b whose 
transmittance varies in the horizontal direction, and the light sources 2a and 2b. 
These ND filters and two light sources are switched to a light transmission 
pattern of the light transmission type liquid crystal display device to cause such 
that the light source to emit emits light twice, or that the light source is left 
lighted to switch to two types of light patterns of the light transmission type 
liquid crystal display device, whereby it is possible to irradiate two types of light 
patterns onto the object on a time sharing basis as in the case of the present 
embodiment. time-shared basis. 

(Third Embodiment) 

FIG. 10(a) is a schematic perspective view showing illustrating a third 
embodiment of a range finder according to the present invention. With reference 
to the figure, the description will be made of the configuration of the present 
embodiment hereinafter. 

As shown in FIG. 10(a), a semiconductor laser 201 is an exemplary light 
source means for emitting light with a wavelength A,. A first optical fiber 202 is 
an exemplary means for guiding light to be emitted from the semiconductor laser 
201 to a light distributor 203. Also, a collimator lens 204 is arranged between 
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the first optical fiber 202 and the semiconductor laser 201. The light distributor 
203 is an exemplary light distribution means for dividing the light guided 
through the first optical fiber 202 into two courses. Also, the light distributor 
203 has a shutter mechanism, and is an exemplary means for transmitting 
thelight divided light to second optical fibers a and b on a time sharing time- 
shared base. The second optical fiber a (205a) and the second optical fiber b 
(205b) are optical fibers connected, each connected at one end thereof, to the 
light distributor 203 respectively, for irradiating the light divided from an 
aperture at the other end onto an object (for example, the inner walls of the 
stomach, or the like). A camera part 206 is an exemplary image pickup means 
for acquiring image data of the object received through light-receiving optical 
fiber bundle 207 by means of reflected light from the object. In this respect, at 
the tip end of the light-receiving optical fiber bundle 207, there is arranged a 
lens 210 in proximity thereto. CCD 209 is an image pickup element mounted to 
the camera part 206 so as to receive light from the light-receiving optical fiber 
bundle 207. Light to be irradiated from the aperture 208a of the second optical 
fiber a (205a) shows such has a light intensity distribution as shown in FIG. 4 
which has been described in the embodiment. Light to be irradiated from the 
aperture 208b of the second optical fiber b (205b) is also the same. These lights 
hashave different light intensity distributions depending upon the position in the 
horizontal direction because light to be emitted from the aperture of the optical 
fiber diffuses based on the angular aperture. Therefore, by adjusting the angular 
aperture, the shape of the light intensity distribution can be changed. In this 
respect, thtsthe angular aperture can be adjusted to some degree by setting the 
refractive index of the optical fiber in the diameter-wise direction to a 
predetermined value. 

In this respect, a range finder according to the present embodiment has 
distance calculation means (not shown) provided with the same function as the 
distance calculation part 6 described in the embodiment, for calculating a 
distance up to the object on the basis of image data from the camera part 206. 
Also, for both the first optical fiber 202 and the second optical fibers a and b 
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(205a and 205b), or either of them, the optical fiber bundle may be used as a 
matter of course. 

With the above-described configuration, the operation of the present 
embodiment will be described with reference to FIG. 10(a). 

A range finder according to the present embodiment can be utilized as an 
endoscope such as a gastrocamera. 

More specifically, the tip ends of the second optical fibers a and b (205a 
and 205b) and the tip end of the light-receiving optical fiber 207 aremay be 
inserted into the stomach of a patient. 

From the apertures of the second optical fibers a and b, light having sueba 
light intensity distribution characteristic as shown in FIG. 4 is irradiated on the 
time sharing time-shared basis as in the case of the first embodiment. The light- 
receiving optical fiber 207 receives light reflected by these this light. Further, 
the camera part 206 transmits the image data on the inner walls of the stomach 
obtained from these this light reflected to the distance calculation part. The 
distance calculation part calculates, as in the case of the first embodiment, the 
three-dimensional distance data on the inner walls of the stomach for outputting. 
The distance data outputted is transmitted to a monitor (not shown) to be three- 
dimensionally displayed. A doctor can, while viewing the monitor, view the 
image of the diseased portion which has been three-dimensionallybeen displayed 
by moving the tip end of the second optical fiber. Thus, the doctor can more 
accurately examine the patient than before. 

In this respect, in the above-described embodiment, thea description has 
been made provided of a range finder configured by one semiconductor laser as 
the light source part, but however, the present invention is not limited thereto, 
and a range finder configured by two light source parts as shown in, for 
example, FIG. 10(b),, may be used. More specifically, in this case, 
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semiconductor lasers 201a and 201b as the light source part are provided with 
optical fibers 205a and 205b for individually guiding those lights the light emitted 
on the object side to irradiate the object. Also, a collimator lens 204a, 204b is 
arranged between each optical fiber 205a, 205b and each semiconductor laser 
201a, 201b. Such a configuration exhibits the same effect as described above. 

Also, in the above-described embodiment, the description has been made 
of the configuration in which there is provided a light distributor 203 between 
the first optical fiber 202 and two second fibers 205a and 205b, buthowever, the 
present invention is not limited thereto, and it may be possible to construct, in 
place of, forexample, the light distributor 203 and the second optical fibers 205a 
and 2Q5b r205b may be constructed such that light guided from the first optical 
fiber is divided into two courses at the tip end portion of the fiber and there is 
provided light branch means (not shown) are provided for irradiating the object. 
In this case, the second optical fiber can be omitted, and yet while the same effect 
as described above is exhibited. 

Also, in the above-described embodiment, the description has been made 
of thea configuration in which nothing has been provided in front of the optical 
fibers 205a and 205b as shown in FIG. 11(a), but however, the present invention 
is not limited thereto, and it may be is possible to construct such that arrange a 
collimator lens 301 (See FIG. ll(b).) is arranged at the front of the aperture 
208a, 208b of each optical fiber 205a, 205b, or tha tto arrange a cylindrical lens 
(or a rod lens) 302 (See FIG. ll(c).) is arranged at the front of each aperture 
208a, 208b. This enables the intensity of light to be irradiated from the aperture 
to be position-wise uniformly varied more effectively . In this respect, it is also 
possible to output light, which has no different light intensity locally, local light 
intensity, from the front of each aperture 208a, 208b, and instead, to arrange a 
transmittance change filter 1 (303a) and a transmittance change filter 2 (303b), 
whose light transmittance differs position-wise, at the front of each aperture 
208a, 208b. 
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With reference to FIGS. 12(a) and (b), the a further descriptionwill-be 
further made of the characteristic properties of the filter shown in FIG. 11(d) is 
provided . 

The intensity distribution of light, which passed light that passes through 
the transmittance change filter 1 (303a) shown in, for example, FIG. 12(a), is set 
such that it becomes the one as denoted by the reference numeral 401a in FIG. 
12(b). In contrast, the intensity distribution of light, which passed light that 
passes through the transmittance change filter 2 (303b), is set such that it 
becomes the one as denoted by the reference numeral 401b in the figure. FIG. 
12(b). FIG. 12(b) is a view representing illustrates the light intensity distribution 
for a range a shown in FIG. 4. The present invention can be implemented even 
if such ajxansmittance change filter is used. 

Also, in the above-described embodiment, the description has been made 
of the case where the light distributor has been provided with a shutter 
mechanism in such a manner that the object is irradiated with light on a time 
sharing basis, but the present invention is not limited thereto, and for example, 
light from the light source includes light having a plurality of frequencies, and 
die light distributor is provided with a filter, whereby light having different 
wavelength is irradiated from the aperture. Thus, the camera part is provided 
with a filter and a light receiving element, which are capable of distinguishing 
these two types of wavelength for receiving, to thereby make it possible to 
irradiate the object with each light having two types of wavelength at the same 
time. This enables the measuring time to be shortened. Even in the 
configuration shown in FIG. 10(b), if the wavelength of the semiconductor lasers 
201a and 201b are made different from each other, and the camera part 206 is 
provided with a filter and a light receiving element, which are capable of 
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distinguishing these two types of wavelength for receiving, it becomes possible 
to shorten the measurement time in the same manner as described above. 

Also, in the above described embodiment, a semiconductor laser has been 

used as the light source, but the present invention is not limited thereto, and for 
example, LED, a lamp or the like may be used. 

Next, the description will be made of a camera according to the present 

inventi o n, which is obtained by implementing such a contrivance as to make the 
above described range finder device according to the present invention more 
c o mp a ct and simple in configuration - . - 

More specifically, in the above described range finder device, the light 

passive reflection plates have been disposed in deviated relationship with each 
other with respect to the light sources 2a and 2b as shown in FIG. 2, it is 
necessary to mount light filters whose light transmittance differs depending upon 
the horizontal place in front of the light emitting tube, and it can be said that the 
configuration is complicated. 

Also, unless the camera lens and the light source are spaced more than 

several tens centimeters apart from each other, the measurement accuracy will 
not be possible because the triangulation is used, and the camera would be 
considerably large even if an attempt is made to house them within the camera 
housing. 

Also, there was a defect that it is impossible to simply calculate to 

measure the sizes or dimensions of an object image picked up with a 
conventionally known camera unless the distance up to the object is known. 
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Also, it was impossible to know the sizes of the object from a color image once 
picked up. 

Also, when an attempt is made to extract an object from an image picked 

up with a conventionally known camera, an environment having a background of 
a single color must be prepared in advance, and large scale preparation was 
required. 

Hereinafter, with reference to the drawings, the description will be made 

of a shape measuring camera and an object extracting camera capable of solving 
those inconveniences and the like, according to an embodiment of the present 
invention, a description has been provided where the light distributor includes a 
shutter mechanism such that the object is irradiated with light on a time-shared 
basis, however, the present invention is not limited thereto. For example, light 
from the light source includes light having a plurality of frequencies, and the 
light distributor may be provided with a filter, whereby light having a different 
wavelength is irradiated from the aperture. Thus, the camera part is provided 
with a filter and a light-receiving element, capable of distinguishing between 
these two types of wavelengths, thereby making it possible to irradiate the object 
with each light having two types of wavelengths at the same time. This reduces 
the measuring time. In FIG. 10(b), if the wavelength of the semiconductor 
lasers 201a and 201b are different from each other, and the camera part 206 is 
provided with a filter and a light-receiving element, capable of distinguishing 
between these two types of wavelengths, it is possible to reduce the measurement 
time, as described above. 

Also, in the above-described embodiment, a semiconductor laser has been 
used as the light source, however, the present invention is not limited thereto. 
For example, a LED, a lamp or the like may be used as the light source. 
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A description of a camera according to the present invention is now 
provided. Through this exemplary embodiment, a range finder device that is 
more compact and having a simple configuration is provided. 

More specifically, in the above-described range finder device, the light 
passive reflection plates are disposed in a deviated relationship with each other 
with respect to the light sources 2a and 2b as shown in FIG. 2. In such an 
arrangement it is typical to mount light filters whose light transmittance differs 
depending upon the horizontal place in front of the light-emitting tube, resulting 
in a configuration is complicated. 

Also, unless the camera lens and the light source are spaced more than 
several tens of centimeters apart from each other, the measurement accuracy will 
be poor because triangulation is used, and the camera would be considerably 
large even if an attempt is made to house them within the camera housing. 

Also, it is impossible to calculate or measure the sizes or dimensions of an 
object that is image-picked up with a conventionally-known camera unless the 
distance to the object is known. Also, it has been impossible to know the sizes 
of the object from a color image that has been picked up. 

Also, when an attempt is made to extract an object from an image picked 
up with a conventionally-known camera, an environment having a single color 
background is typically prepared in advance, resulting in a large-scale 
preparation. 

Hereinafter, with reference to the drawings, a description is provided of a 
shape measuring camera and an object extracting camera capable of solving the 
above described deficiencies. 
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FIGS. 13(a) and 13(b) are diagrams illustrating a shape measuring camera 
and an object extracting camera according to a fourth embodiment of the present 
invention. Also, FIG. 20 is a block diagram showing this camera. 

In FIG. 13, the reference numerals 501 and 502 denote a camera housing; 
503, a photographing lens; 504, recording media; 505 and 506, first and second 
strobes, each forming the light source part respectively; and 507, a finder. 

In FIG. 20, the reference numeral 532 denotes a display part; 533, an 
image pickup part; 534, a light source control part; 535, a distance calculation 
part; 536, a color image calculation part; 538, a media recording/reproducing 
part; and 550, an image memory. 

TkisThe shape measuring camera is configured such that a housing 501 
containing the camera part and a housing 502 containing a light-emitting part 
have different thicknesses from each other and can be fitted therefore be fit into 
each other in an overlapped manner as shown in FIG. 13(a), and further that the 
state of FIG. 13(a) or the state of FIG. 13(b) can be selected by the sliding the 
housings 501 and 502 by the user. — During carrying, the with respect to one 
another. As such, a small-sized state is kept in the state o f camera is provided 
for carrying in FIG. 13(a), while during image picking up, the housing is 
extended into such a state for image-pickup as shown in FIG. 13(b) for use. This 
enables an 13(b). An interval D between the center of the lens 503 and the 
strobe 505, 506 in the light source part is set to beset large during use of the 
usar camera. FIG. 20(a) shows a simple type using configuration that includes no 
image memory 550, and FIG. 20(b) shows a type having configuration that 
includes an image memory, capable of image- image picking up and displaying 
a tpick up and display at a high speed. 

The strobe 505, 506 in the light source part is constructed as shown in, 
for example, FIG. 2, and is configured by includes a strobe light-emitting tube 
530 and a shading plate 528 having a hole with the position of its center 
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shtftedr shifted center position. Light emitted from the segment of a light- 
emitting tube 530 is emitted while the way path of intercepted light is 
varying varies depending upon the position byof a shading plate 528 as shown in 
the plan view of FIG. 15. At this time, thc The position of the hole in the 
shading plate 528 is deviated from the strobe light-emitting tube 530, and such 
light as to become as such, light becomes increasingly intenser more intense from 
point A toward point B on a straight line 1 is generated. R This generatessueh a 
light pattern that where the light intensity varies inthe opposite directions to each 
other from two strobe light-emitting tubes., as shown in FIG. 16. Next, the A 
description will be made is now provided of a method ferof calculating a depth 
distance using such light. In this respect, the description is its contents are 
almost the same as similar to the calculation method for depth distance already 
described. 

A light pattern thus obtained is a pattern in which the light intensity varies 
as shown in FIG. 17. FIG. 18 one dimensionally shows these illustrates the 
variations in the light intensity in the horizontal X direction. I n X-direction (one 
dimension). In the a portion of this light pattern, light to be irradiated from the 
two light sources into the object space becomes space becomes bright on the right 
side in one and bright on the left side in the other, as viewed from each light 
source. This pattern varies, however, also in the height-wise direction (Y 
direction) . 

FIG. 19 shows the relation ship between the light intensity ratio and an 
angle § from the light source in the horizontal direction in the object illumination 
by the above-described two projected light in the a portion of FIG. 18. In the a 
portion, the relation ship between the light intensity ratio and the angle (J) from 
the light source in the horizontal direction is a one-to-one correspondence 
therebetween . In order to measure a distance, it is necessary desirable to 
alternately project two types of light patterns onto a plane which has been set up 
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vertically in advance, and to obtain in advancesueb data on the relatio nship 
between the light intensity ratio and the p osition from the light source in the 
horizontal direction as shown in FIG. 17 for each Y-coordinate., from the result 
obtained by image-picking up thisthe reflected light with the camera 501. 

Also, if the light sources are located such that a segment between the lens 
center of the camera 501 and the light source runs horizontal to the X-axis of the 
image pickup surface, the distance can be accurately calculated through the use 
of data on the relation ship between a light intensity ratio determined for each Y- 
coordinate and positions from the light sources in the horizontal direction. This 
is calculated by the distance calculation part o fillustrated in FIG. 20(a). 
Hereinafter, thea description will be mad e is provided of a distance calculation 
method using the light intensity ratio. 

In the case where a point P in FIG. 20(a) is set to an attention point, when 
two types of light patterns from respective strobes 505 and 506 in the light 
source concerning the point P on an image picked up by the image pickup part 
533 on the basis of the user's image picking up intention are projected by the 
light source control part 534 on a time sharing time-shared basis, an angle <|> of 
the point P as viewed from the light source is measured through the use of a 
luminance ratio obtained from the image pickup data, which is the output from 
the image pickup part 533, and the relationship of FIG. 19 
corresponding corresponds to the Y-coordinate value of the point P. 

In this respect, the assumption is made that the relationship of FIG. 19 has 
characteristic properties that differ depending upon the Y-coordinate value-^as 
described above , and that the relatio nship between the light intensity ratio and 
the angle § from the light source in the horizontal direction has been prepared 
for eachY 1 - Y-coordinate by measurement in advance. Also, an angle G with 
respect to the point P as viewed from the camera is determined from the position 
(that is, pixel coordinate value of point P) in the image, and a camera parameter 
(focal length, optical center position of lens system). Thus, the distance is 
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calculated from the above above- described two angles and the distance (base 
length D) between the light source position and the optical center position of the 
camera 2 in accordance with the principle of triangulation. 

Assuming that the optical center of the camera to be is the origin, and 
setting the optical axis direction of the camera as the Z-axis, the horizontal 
direction as the X-axis, the vertical direction as the Y-axis, and assuming an 
angle, made by the X-axis, of the direction of the attention point as viewed from 
the light source to be <|>, an angle, made by the X-axis, of the direction of the 
attention point as viewed from the camera to be 0, and the light source position 
to be (0, -D), that is, the base length to be D, then the depth value Z of the 
attention point P can be calculated asusing the following formula: 

Z = D tan 6 tan <j> /(tan 0 - tan <J>) 

When the value of D (distance between lens and light source part) is small 
at this time, , the accuracy of the depth value Z measured is degraded. If the D 
value is set to 20 to 30 cm for an object up to a distance of, for example, about 3 
m, the depth can be measured with an error of plus or minus about 1% of the 
measured distance. As the D value becomes smaller than 20 to 30 cm, the 
measurement error further increases. Also, the X and Y coordinates of the 
attention point P are given by the following formulas: 

X = Z / tan 9 

Y = Z / tan co 

Also, a color image calculation part 536 calculates an image obtained by 
adding and averaging image pickup data when the above-described two types of 
light patterns are irradiated to make rt the image into a color image. These two 
types of light patterns have characteristic properties such that the brightness 
varies complementally to each other as shown in FIG. 18, and by adding and 
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averaging them, the same color image as a color image obtained by picking up 
with strobes with uniform brightness can be obtained. 

The color image and depth image which have been thus obtained are 
displayed on a display part 532, and are recorded in recording media 504 
through a media recording/reproducing part 538. Of course, the color image 
and depth image which have been once recorded can also be read out by the 
media recording/reproducing part 538 to be displayed on the display part 532. 

If the image data from the image pickup part 533 isenee accumulated in 
an image memory 550 as shown in FIG. 20(b), the image can be continuously 
inputted. Also, a plurality of images recorded on the recording media 504enee 
ake can be read out on the image memory 550 to be reproduced and displayed at 
ajiigh speed. 

According to the present embodiment as described above, it is possible to 
generate a plurality of light patterns in a single configuration, and to realize a 
shape measuring camera with a_stable configurationenly through the use of a 
straight-line shaped strobe light-emitting tube and a shading plate with a hole for 
a light intensity change pattern. 

Also, it is possible to realize a shape measuring camera capable of taking 
the a large interval Dlafge between the lens 503 and the strobes 505 and 506 in 
the light source part by making it small sized during carrying and making it small 
during non-use (e.g., carrying the camera), and by extending the main body 
during image-picking up, and capable of measuring a depth image with high 
accuracy. 

(Fifth Embodiment) 

FIG. 28 is a block diagram showing a shape measuring camera and an 
object extracting camera according to a fifth embodiment of the present 
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invention. In FIG. 28, the reference numerals 501 and 502 denote numeral 501 
refers to a camera housing; 505 and 506, first and second strobes, each forming 
the light source part respectively; 518, a display panel; 519, a touch panel; 532, 
a display part; 533, an image pickup part; 535, a distance calculation part; 536, 
a color image calculation part; 538, a media recording/reproducing part; and 
537, a control part. Hereinafter, the description will be made of the operation of 
the shape measuring camera and the object extracting camera having the above- 
described configuration. 

FIG. 27 shows the back of the shape measuring camera. On the back, the 
display panel 518 and the touch panel 519 are piled up in a the same position to 
display a color image or a depth image which has been picked up, and are 
configured such that the user can denote the attention position (coordinate) in the 
image using thea finger or a rod-shaped object. 

FIG. 28 is a block diagram showing useful for describing a display and 
distance measurement apparatus and process . A distance image and a color 
image which have been picked up are inputted into the control part 537, and the 
user's attention position designating coordinates are also inputted into the control 
part 537. The control part 537 displays a color image picked up on the display 
panel 518 and calculates an actual distance and the like from a plurality of 
attention designating coordinates inputted by the touch panel 519 and a depth 
image to display on the display panel 518. 

FIG. 25 shows illustrates an aspect of attention position designation. First, 
it is assumed that a color image for a desk picked up by the user is displayed on 
the display part 518. The user denotes designating designation points A523 and 
B524 using thea finger or a rod-like object. 

When thcy When the points are denoted, the shape measuring camera 
calculates the distance Lab of a segment AB between points A and B, that is, 
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Lab = 7{( Xa - Xb) 2 + (Ya - Yb) 2 + (Za - Zb) 2 J 

using the values of actual coordinates A (Xa, Ya, Za) and B (Xb, Yb, Zb) 
of respective coordinate positions of the depth image obtained to display be 
displayed in another portion on theof display panel 518. In this example, it-isthe 
displayed that the length of AB is 25 cm. In this manner, the user can measure a 
distance between points, which should be measured, of the object image-picked 
up without touching it even if it is a length distance in the depth- wise direction. 

Also, the size of a circular object and not (not a straight line-shaped 
object) can be measured in *hea similar manner. FIG. 26 shows the case 
where illustrates a circular table that has been image-picked up. For example, 
while viewing a color image which has been image-picked up and displayed on 
the display panel 518, the user denotes three points, A523, B524 and C526 ef-an 
adequate position of on a circumferential portion of a circle to be measured by 
touching ihem the points on the touch panel using the finger or a rod-shaped 
object. 

Thereafter, the shape measuring camera determines, from space 
coordinate values A (Xa, Ya, Za), B (Xb, Yb, Zb) and C (Xc, Yc, Zc) for these 
three points, a formula for a circle which passes through these points. Although 
there are various methods for determining it, for example, perpendicular 
bisectors for segments AB and BC are may be determined and their point of 
intersection is assumed to be the center G (Xg, Yg, Zg) of the circle. Next, a 
mean value of the length of segments GA, GB and GC can be made into the 
radius of the circle. 

The radius thus obtained is displayed to be 50 cm in FIG. 26, of which 
the user is notified. By doing so, the size of such a complicated shape as a circle 
can also be measured without touching the object. In addition, for any shape 
having a mathematical expression for defining the shape such as an equilateral 
triangle and an ellipse, its size can be measured from the depth image without 
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touching the object by the user designating a plurality of points by the user . 
Also, in this case, the user has inputted the coordinates for the attention point by 
using the touch panel, but however, it may be possible to display a cursor (such 
as a figure of cross), which moves left, right, up or down, on the display panel 
518, and to denote points by moving its the cursor position with a push-button for 
inputting to input the coordinates for the attention point. 

If the size calculation result effor the object is recorded in the recording 
media 504 through the media recording/reproducing part 538, it is not necessary 
for the user to keep the measur e ment result in mind, but remember the 
measurement, because the measurement result can be fetched from the recording 
media 504, and can be conveniently used by equipment (such as a personal 
computer) having the same function as the media recording/reproducing part 538 
capable of reading and writing the measurement result. Of course, the 
measurement result may be superimposed on the color image picked up to be 
preserved as an image. 

In the foregoing example, the length of the object has been measured, and 
it is also possible to measure a plurality of length for determining the area or 
volume on the basis thereof. lengths to determine the area or volume. 

Further, another example of display and utilization of the pickup data will 
be described. 

As shown in FIG. 27, on the back of the camera, the display part 518 and 
the touch panel 519 are piled up in a the same position to display a color image 
or a depth image which has been picked up, and are configured such that the 
user can denote the attention position (coordinate) in the image using the finger 
or a rod shaped object. Through the use of this, a finger or a rod-shaped object. 
Using this device, it is possible to realize an object extracting camera capable of 
obtaining an image obtained by extracting only an object, on which the an object 
on which a user focuses their attention. 
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FIG. 28 is a block diagram showing illustrating the display/extracting 
operation, and where the object extracting camera has basically the same a similar 
configuration asto the above-described shape measuring camera. A distance 
image and a color image which have been picked up are inputted into the control 
part 537, and a_user's attention position designating designation coordinates are 
also inputted into the control part 537. 

The control part 537 can display a color image picked up on the display 
panel 518 and extract only an object, an object at which the user aims T from a 
plurality of attention designating coordinates inputted by the touch panel 519 and 
a depth image to display on the display panel 518 for recording in the recording 
media 504. 

With reference to FIG. 29, the description will be made of this operation. 

First, the assumption is made that the user wishes to extract an object 
520. The user denotes a portion of the object 520 on the touch panel 519. The 
control part 537 obtains the depth value of a portion including by this coordinate 
from the depth image, judges a portion having a depth continuously connected 
therewith as an object, at which the user aims, for displaying only the portion, 
and fills any other p ortions other than the portion with a certain specific color for 
displaying on the display panel 518. 

As regards Regarding the judgment as-teof such a connected portion,se- 
called image processing can be performedthat with a denoted coordinate as a 
starting point, and the area will be expanded left, right, up or down as far as the 
depth value continuously varies and if there is any discontinuous portion in 
depth, the expansion will be stopped of the area will be stopped there . 

A little longer distance than a distance between an object which the user 
wishes to extract and the camera, or a range of such a distance that the user 
wishes to extract is denoted using the touch panel or the push-button. The 
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control part 537 displays a portion of a color image having a closer value than a 
distance denoted by the value, or a color image included only in a portion within 
a range of the denoted distance, while the other portions are filled in with a 
certain specific color. Thus, they are displayed on the display panel 518, and are 
recorded in the recording media 504. 

In this manner, the camera is capable of judging only the object, the object 
at which the user aims, for extracting to display and record it. the object to be 
displayed and recorded. In this case, there is a possibility that depending upon 
the image processing, there arises a portion which is may be erroneously judged 
to be a foreground (instead of background) by a malfunction in spite of a 
backgroundportion as shown in FIG. 30. 

In this case, if the user denotes a the erroneous portion (FIG. 29), in 
which the malfunction seems to have been done, by using the touch panel 519 and 
corrects the display result so that the portion is part of the background, it will be 
possible to obtain a high-quality extracted color image for the object. In this 
case, of course, the user may denote the portion which has been erroneously 
judged to be the background by the malfunction to perform a correcting operation 
so that this portion becomes a foreground. 

By extracting a color image according to the distance using the 
information on the depth image as described above, it is possible to easily obtain 
an image obtained by extracting only an object, an object at which the user aims T 
for preserving . 

Also, in FIG. 28, an image memory is arranged within the control part 
537, and an image to be reproduced and operated used isenee placed enin the 
image memory, whereby it is also possible to make the access speed for the 
images faster, or to^switch a plurality of images to high speed for displaying and 
operating, display and operation. 
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According to the present embodiment as described above, it is also 
possible to measure an actual size of an object without touching it. Also, it is 
possible to realize a shape measuring camera and an object extracting camera 
capable of easily extracting only an object, an object at which the user aims, on 
the basis of its depth information, information for preserving. 

In the fourth embodiment, thea similar effect can be obtained even if the 
housing for the shape measuring camera is constructed as shown in FIG. 21. 
More specifically, the configuration is arranged such that a camera part 509 
containing an image pickup part 533 and a strobe part 508 containing first and 
second strobes 505 and 506 forming a light source are connected together by a 
joint 510 having a hinge-like configuration in such a manner that the user can 
freely fold and extend the camera as shown in FIG. 21(a) and extend as shown in 
FIG. 21(b). During carrying, the The camera housing is small-sized in such a the 
stateas shown in FIG. 21(a) (e.g., when carrying the camera) , and during image- 
picking up, if it is extended as shown in FIG. 21(b) for use , the interval D 
between the lens 503 and the first and second strobes 505 and 506 in the light 
source can be made larger. 

Also, the configuration can be arranged such that the lens and the first and 
second strobes 505 and 506 are vertically arranged as shown in FIG. 21(c). In 
this case, in the depth image calculation, while as opposed to the angles § and 0 
are relating to changes in the horizontal direction as described in the foregoing, 
the changes are only performed in the vertical direction, and the depth image can 
be calculated by thea similar calculation for the other direction s. In order to 
cause changes in the light intensity in the vertical direction, the light source is 
configured by vertically-laid light-emitting tubes as shown in FIG. 21(d). 

In this case, even if the configuration is arranged such that a housing 501 
containingsueh a camera part as shown in FIG. 21 and a housing 502 containing 
a light-emitting part have different thickness from each other thicknesses and can 
be fitted into each other in a superimposed manner in a vertical direction as 
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shown in FIG. 23, thea similar effect can be obtained. At this time, the light 
source part is constructed as shown in FIG. 23(d) [sic]. 

In the fourth embodiment, thea similar effect can be obtained even if the 
housing for a shape measuring camera is constructed as shown in FIG. 22. 
More specifically, the housing 517 containing 517, that contains the first and 
second strobes 505 and 506 in the light source part is made small - sized, part, is 
made small in size, and is connected to the camera housing 501 using thea hinge 
configuration. During the use, the housing 517 is turned by the user to thereby 
expose the first and second strobes 505 and 506 in the light source part, whereby 
normally the housing can be made small siz c d is small in size while the first and 
second strobes 505 and 506 in the light source part are not exposed to thereby 
prevent (p re venting them from being damaged due to any careless contact), and at 
the same time, during image-picking up, the interval D between these strobes 
and the lens can be made large. enlarged. 




In the fourth embodiment, although the light source is constructed as 
shown in FIG. 2, even if the configuration is arranged such that there is provided 
one light-emitting tube 529 and a liquid crystal barrier 5314s placed in front 
thereof as shown in FIG. 24(a), it is possible to have thea similar light pattern 
generating function. 

In this case, i fit is arranged that each light transmittance portion is 
sequentially provided on the left side of the light-emitting tube 529 as shown in 
FIG. 24(b) and provided on the right-side thereof as shown in FIG. 24(c) in such 
a manner that the light-emitting tube 529 sequentially emits light onee at a time 
in the respective states, then the same light pattern as shown in FIG. 18 can be 
generated by sequentially causing one light-emitting tube to emit light twice 
without using two light-emitting tubes as shown in FIG. 2. 

This enables a small number of light-emitting tubes to emit light as if light 
were emitted from the same position instead of light-emitting patterns being 
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emitted from positions a little deviated vertically deviated as shown in FIG. 2, 
and any measurement error in depth tecan be reduced. 

This is because in FIG. 20, the position of an emitting point Q of the light 
pattern is deviated in the perpendicular direction in the present embodiment, 
whereas in this case, it is at the same position, and therefore a straight line PQ 
becomes a line, and less errors occur than in the depth calculation using a 
straight line having different vertical positions. 

Also, in this case, the entire surface of a liquid crystal barrier 531 is 
placed in a light transmitted state as shown in FIG. 24(d), whereby it can be 
utilized as a strobe for the camera for picking to pick up a normal two- 
dimensional image. 

Also, according to the fourth embodiment, in the main bodies of the shape 
measuring camera and object extracting camera, the depth image and color 
image are calculated, and calculated and then recorded in the recording media. 
As shown in FIG. 31, in the main body of the camera, image data picked up in 
synchronism with the first and second strobes 505 and 506 in the light source is 
recorded in the recording media 504 through the media recording/reproducing 
part 538, and the image data is read out by an analysis device 39 configured by a 
personal computer or the like to obtain a_desired analysis result by the distance 
calculation part 535 and the color image calculation part 536. Thus, the object 
may be extracted or the shape may be measured using the display part 532. 

The image data can also be transferred to the analysis device 539 , and not 
through the recording media 504. For example, the camera body and the 
analysis device 539 are connected together using existing data communication 
means. The data communication means may be, for example, In the wire 
communication, wire communications such as a parallel data interface, serial data 

interface and telephone circuits can be used. fe— th ecircuits. The data 

communication means may also be radio communication, optical 
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communication, infrared-ray communication, portable telephone network 
communication and radio wave communication can be used . Further, the 
analysis result can be recorded in the recording medium. 

In this case, the image pickup part 533 is a moving image picking up 
video camera, and when the recording media 504 is a recording medium such as 
tape, it is normally utilized as a camera for picking up a color moving image. If 
the user lights a flash by pressing the push-button only when necessary and such 
an index signal as to allow only a video (such as a frame and a field) for field), 
the portion to be distinguished is stored in a recording medium in advance, and 
the analysis device 539 is capable of extracting only an image for a portion 
having an index signal and calculating the color image and depth image only for 
the portion for outputting. 

Also, in the fourth embodiment, the camera housing 501 has been 
provided with the light source part from the beginning, but it is conceivable to 
ut&ze part, however, in an alternative embodiment of the present invention 
includes a method to make only the light source part removables such a mann e r 
that it is in a small sized small in size and easily-portableshape during normal 
color image picking up and that the light source part is mounted for use only 
during depth image picking up. 

FIG. 37(a) shews illustrates an external light source having such a structur e 
as an external strobe device for photography, mounted thereon withsueh a light 
source as shown in FIGS. 2 and 24. It is used by connecting it to the camera 
housing 501 as shown in FIG. 37(b) through a joint 549 with the camera. FIG. 
38 shows . FIG. 38 illustrates an example for such a exemplary light source for 
eliminating any shadow of the object as shown in FIGS. 35 and 36. 

In FIG. 38(a), light sources are symmetrically arranged on both sides of 
the joint 549. An aspec t A view of the light sources connected to the camera is 
shown in FIG. 38(b). Also, in FIGS. 37 and 38, the camera body is connected 
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to the light sources usingsueh a structure such as a strobe shoe for film cameras, 
and a mounting method ofmounting using a tripod mounting screw for cameras 
asis shown in FIG. 39(a) is also conceivabl e. 

In this case, it is configured such that a screw at the bottom of the camera 
housing 501 is used for mounting as shown in FIG. 39(b). If the light sources 
are separated as such (e.g., a removable external light source device}, the camera 
beeemesis large only during depth image picking up, andbut when used as a 
normal camera, it eanis conveniently become compact and lightweight. 

Also, in the fifth embodiment, the user can denote a coordinate using the 
touch panel in the configuration of FIG. 31, and other means can be used. 
When for example, a personal computer is used, an input device such as a mouse 
or a keyboard can be used. In addition, a track ball, a switch, a volume and the 
likebe can also be utilized. 

Also, in the fourth and fifth embodiments, the first and second strobes 
505 and 506 in two light source parts are arranged at one side of the image 
pickup part 533 as shown in FIGS. 13, 21, 22 and 23, and in this case, when an 
object 540 and the background 541 are image-picked up insueh an arrangement 
such as that shown in FIG. 32, light from the light sources is intercepted by the 
object 540 (as shown in FIG. 33) to cause a shadow 542 in an image to be 
obtained . obtained image. 

This portion is an area where light from the light sources does not reach, 
and is an area where any information asof a distance image cannot be obtained. 
In this case, light sources 543 and 544 having the same configuration as the first 
and second strobes 505 and 506 in the light sources and are arranged at a side 
opposite thereto with the lens asat the center as shown in FIG. 34, whereby the 
area of thisthe shadow can be eliminated. The method will be described below. 
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When the first and second strobes 505 and 506 in the light sources are 
used, an area p is a portion whereany information asof a distance image cannot 
be obtained, and when the light sources 543 and 544 are used, an area a is a 
portion wherea«y information asof a distance image cannot be obtained. In the 
same manner as in the foregoing calculation, a distance image A and a color 
image A {when the first and second strobes 505 and 506 in the light sources are 
used), and a distance image B and a color image B {when the light sources 543 
and 544 are used), are independently calculated respectively in advance. At this 
time, in the respective images, the portions in the areas (3 and a are judged to be 
portions having low luminance from the image data obtained in advance. 

Next, the distance images A and B are synthesized to newly generate a 
distance image free from any shadow area. This can be realized by adopting, if 
there exists an area which is not judged as the above-described portion having 
low luminance in either of the distance images A and B, its value, and if neither 
of them is not the shadow area, by using an average value of both pieces of 
image data. 

The same is applicable to a color image, and if at least either of the color 
images A and B has datafef other than the shadow portion, it is possible to 
synthesize a new color image free from any shadow area. 

In case of the foregoing configuration, it is necessary that light sources be 
arranged on the lateral sides or vertical sides of the lens. In this case, if the 
housing is configured such that housings 512 and 513 containing light source 
parts on the lateral sides of the camera body 511 are slid in opposite directions 
so as to be extended as shown in FIG. 35, the user can make it small sized into 
fee-state reduce the size as shown in FIG. 35(a) for carrying during carrying, the 
camera, and extend it as shown in FIG. 35(b) to takemake the base lengthl) 
large duringthe use, making it possible to prevent the depth image measuring 
accuracy from being degraded. 
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Also, tbea similar effect can be obtained even if the configuration 
is arranged such that the camera housing and the light sources can be folded into 
three stages as shown in FIG. 36. During carrying, they can be made small sized 
by folding as shown in FIG. 36(a) for carrying, and during the use, the interval 
between the lens and the light sourccs, While carrying the camera, the size can be 
reduced by folding the camera as shown in FIG. 36(a), and during use, the base 
length D can be taken large by ext e nding th c m enlarged as shown in FIG. 36(b). 

Also, in order to arrange the lens and the light sources vertically as shown 
in FIG. 21(c), the housings 512 and 513 of FIG. 35 can be arranged on the 
vertical sides of the housing 511, and in FIG. 36, the housings 512 and 513 can 
be arranged on the vertical sides of the housing 511. 

Industrial Applicability 

As will be apparent from the foregoing description, according to a range 
finder device of the present invention, it is possible to provide, at low cost, a 
highly reliable range finder device capable of realizing all by using electronic 
operations and not including any mechanical operations. 

Also, according to a range finder device of the present invention, it-is 
capable of measuring a distance with excellent accuracy,, even if light from the 
light source has a two-dimensional pattern , may be accomplished . 

Also, according to a range finder device of the present invention, it-is 
capable of measuring a distance of an object in a place where light from the light 
source cannot be directly irradiated onto an objec t may be accomplished . 

Further, according to a camera of the present invention as described 
above, a light source part having a simple configuration and high serviceability 
can be realized. Also, it has the eff e ct that the depth image measuring accuracy 
is not degraded because the distance between the camera lens and the light 
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sources can be secured more than several tens of centimeters duringtbe use 
although it is small sized during carrying. Also, the length and size of the object 
can b esimply measured without touching, and the size of an object can be 
knewn determined from a color image once the image is p icked up. Also, it is 
possible to provide a shape measuring camera and an object extracting camera 
capable of simply oxtracting simple extraction of an object to be aimed at from an 
image photographed. 
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ABSTRACT 



A range finder device, for measuring, when a plurality of projected lights 
having radiation patterns whose light intensity differs three-dimensional space- 
wise are irradiated onto an object from a light source on a time-sharing basis to 
image-pick up reflected light of the projected light from the object with a 
camera, a distance using the light intensity of an image picked up, characterized 
in that, with respect to each of a plurality of surfaces including the center of the 
light source and the center of a lens, there is obtained, in advance, relation 
between an angle of each projected light from the light source and light intensity 
ratio in each surface, characterized in that, at the time of actual distance 
measurement, light intensity of each pixel of the camera is measured, and on the 
basis of the light intensity thus measured, and relation between the angle and the 
light intensity ratio on a predetermined surface corresponding to a coordinate 
position of the pixel measured, there is obtained the angle corresponding to the 
light intensity of the predetermined pixel thus measured, and characterized in 
that, on the basis of these light intensity measured, the angles obtained and 
further two-dimensional coordinate position information on the predetermined 
pixel on the image, a distance to the object is calculated. 



